Floating point

Results: 1574



#Item
251Applied mathematics / William Kahan / Floating point / Computer / Numerical analysis / Parallel computing / Software bug / Algorithm / IEEE 754-2008 / Computer arithmetic / Computing / Mathematics

File: NeeDebug Needed Remedies for the Undebuggability … Version updated February 15, 2011 9:29 am

Add to Reading List

Source URL: www.cs.berkeley.edu

Language: English - Date: 2011-02-15 13:00:10
252Numerical analysis / Rounding / Everything2 / Floating point / Error / Round-off error / Systematic error / Numbers / Mathematics / Measurement / Arithmetic / Data types

Comment codes for lab writeups A. General a1. Don’t write numbers without units. (25% off) a2. If something is wrong, cross it out. Don’t make me guess which version to grade. a3. Your writeup is too long. The length

Add to Reading List

Source URL: www.lightandmatter.com

Language: English - Date: 2015-02-09 18:07:49
253Mathematical physics / Matrix theory / Linear algebra / IEEE standards / Floating point / Eigenvalues and eigenvectors / Rounding / Interpolation / IEEE 754-2008 / Algebra / Mathematics / Computer arithmetic

Hyperbolic Interpolation and Iteration towards a Zero File: 9Sep09 Version dated September 16, 2009 6:48 am

Add to Reading List

Source URL: www.cs.berkeley.edu

Language: English - Date: 2009-09-16 09:49:40
254Rounding / Floating point / MPFR / Mathematics / Computing / Computer arithmetic / Unit in the last place / Numbers

THE MPFR LIBRARY: ALGORITHMS AND PROOFS THE MPFR TEAM Contents 1. Notations and Assumptions 2. Error calculus

Add to Reading List

Source URL: www.mpfr.org

Language: English - Date: 2009-06-22 08:55:19
255Procedural programming languages / Array programming languages / IBM 7090/94 IBSYS / Fortran / Subroutine / Numerical analysis / Library / Compiler / Floating point / Computing / Computer programming / Software

File: 7094II.doc Version dated

Add to Reading List

Source URL: www.cs.berkeley.edu

Language: English - Date: 2010-07-12 03:36:21
256Computer arithmetic / Computing / Algorithm / Mathematical logic / Theoretical computer science / Quicksort / Floating point / Sweep line algorithm / Insertion sort / Mathematics / Sorting algorithms / Order theory

CCCG 2007, Ottawa, Ontario, August 20–22, 2007 Experimental Evaluation of Structural Filtering as a Tool for Exact and Efficient Geometric Computing Stefan N¨ aher

Add to Reading List

Source URL: cccg.ca

Language: English - Date: 2008-10-28 21:24:03
257Computer file formats / Hexadecimal / Vector graphics markup languages / Computer arithmetic / Computer graphics / Calculator / Clipboard / Binary file / Paint / Computing / Binary arithmetic / Graphics file formats

HexCalculator( a hexadecimal floating point calculator) This hexadecimal calculator is actually a floating point hexadecimal calculator . The Windows calculator has integer hexadecimal number processing capability also

Add to Reading List

Source URL: omidmotahed.com

Language: English - Date: 2014-12-30 10:20:40
258Computer arithmetic / Real-time operating systems / Computer errors / Primitive types / Exception handling / RMX / Page fault / Floating point / Printf format string / Computing / Control flow / Software engineering

INtime Exception Handling

Add to Reading List

Source URL: www.tenasys.com

Language: English - Date: 2012-10-11 17:57:55
259Complex analysis / Mathematical series / Integer sequences / Combinatorics / Arbitrary-precision arithmetic / PARI/GP / Pi / Floating point / Rounding / Mathematics / Mathematical analysis / Computer arithmetic

A Tutorial for PARI / GP (versionThe PARI Group

Add to Reading List

Source URL: pari.math.u-bordeaux.fr

Language: English - Date: 2014-01-29 14:49:21
260William Kahan / Floating point / Derivative / Variance / Interest / Rounding / Cross product / Area / Logarithm / Mathematics / Mathematical analysis / Computer arithmetic

File: Hdlbrg2 Desperately Needed Remedies … Version dated September 17, :37 am

Add to Reading List

Source URL: www.cs.berkeley.edu

Language: English - Date: 2014-09-17 13:50:50
UPDATE